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ABSTRACT 

A Study designed co investigate the validity of using 
scale scores in lieu of factor scores for factors derived from a 
factor analysis technique is presented. The Work Values Inventory 
(WVI) was selected for use because of its purported factor structure. 
The population consisted of ninth-grade students from a suburban area 
of a large metropolitan center. A random sample of approximately 60 
students was obtained from each of four schools. Scores for each 
subject were computed by two different methods: factor scoring and 
summative scoring. Fewer than 15 factors are required to define the 
work value dimensions included in the, WVI. The common variance 
between the two techniques ranged from 43.6% to 70.6% with an average 
of 54.76%. It is tentatively concluded that the degree to which the 
correlation of summative scores and factors scores computed on the 
same data deviate from unity is an estimation of their deviation from 
"conceptual validity. " (CK) 
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l?nl1 I'f^^ V "^'^ ^ T "f^'S OOCUWENT HAS BEEN REPRO 

J.UJ.J.^.L- L*. \L:..\\ici^ DUCED EXACTLY AS RECEIVED FPOM 

UniVC'TS-! f V fA i 7 1 1 r i THE PERSON OR OPGANIZATION ORIG 

^. ^ Xo- t.-i... . INATINGIT POINTS OF ViEW OR OPlN 

IONS STATED DO NOT NECESSARILY 
REPRESENT OFFICIAL OFFICE OF EDU 
CATION POSITION OR POLICY 

A typical procQourc^ in oduca E: lonr:! re^o-rch ie> to c-velop a dnra co\ U-c : \ -r-i 
instrument t.]icit is pri-suiiiahly rjeslcned to i-c?i?ure an overnll v£ir.L-i>] c .uitboul 
considering the underlying cons; Lruct^^ . The instru:iu:nt thv^; constructed ir cirplov.ul 
•to collect dnta. Having collected the data the researcher proccLic:s to '\Jr facicr 
analysis" without any presupj^ositions regerding the .Lr.ctoriol coiuplexity ol the 
instrument. V/ith the factor cmalysis in hcind, l^ovever. it is easy t'- i at icna li/Ui 
the relationship of itcins ond to name the factors derived. The researcher iuuj-:t 
nov7 luske, the decision as to what type of scores he \vill use in tl«c analytic, to 
test th.e hypotheses he originally constructed only nov addijig sub-liypothcses tor 
the newly found factors which are tacitly u^suined to have factorir^l validity. 

Although these procedures and assumptions appear to ll^e orplcrctory r ta ti r.tician 
to be somewhat soxxnd in practice, once the constructs are identified th.roiiRh factor 
analysis, only those items wliich load highest on e^ch fcctor of a rotated factor 
matrix are included in the computation of a particular "factor score." In addition, 
in order to simplify the scoring of the instrument, it is a common practice to pro- 
ceed vithout theoretical justification to generate '^factor scores," or Toore precisely 
scale scores, by summing the standard or raw scores of subjects on those variables 
which have largest loadings on the rotated factor matrix. As noted* by Gloss and 
Taylor (1966) sonietiraes, though less frequently, the loadings of variables on a 
factor are used as coefficients in a linear combination of standard scores to yield 
^'factor scores." Glass and Taylor further state that "both of the^^e techniques are 
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v:rong, vhat:hcr they are applied to ccinpoT^cmts or in con-on-factor aiKilVi: i:; , " 
Glass and Maguira (1966) note, that this proced-..-t? vrlll 7)ro6>.\cc n pet of 
''fiictor scores" having fevj prcp^^rrjcs of the Icgitinare factor i^coras deslrod. 
"FcActor scores" tl-us deriv^^d trt^.quently have Icu'ge non-r.cro inturcorrclo l:io:is . 
ObibchivQ of the I nq uiry . 

Tliis study v/as designed to inveslii^ata the validity of using scale <^corc:? 
in lieu of factor scores for factors derived froin a factor analysis tochniriua. 
More specifically, do scale scores deiived by sunining the response <--.coro of the 
items which load the highest on the various factors have adequate relationships 
to the factor scores and produce sufficiently similar results v;hcn employed as 
independent variables to justify their use for attitudinal type researcli. 

Tlie Work Values Inventory (VJVI) by Super (1970) was selected for Uc:o in 
this study because of its purported factor structure (O'Connor and Kiirnane, 1961; 
Gable and Pruiiek, ]971). The WVI is designed as a wide rani^e value inventory to 
assess the goals which motivate man, including values which are both extrinsic 
to as well as intrinsic in work. Work values purportedly measured include 
Creativity, Management, Achievement, Surroundings, Supervisory Relations, VJay of 
Life, Security, Associates, Esthetics, Prestige, Independence, Variety, Economic 
Return, Altruism, and Intellectual Stimulation. Thus the underlying constructs 
have been thoroughly considered in the development of this instrument. 

Popu lation. 

i:he population consisted of ninth-grade students from a suburban area of a 
large metropolitan center. A random sample was obtained by randomly ordering the 
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scliools ar.cl contacting them in order uiilril four cooporviciiv; schools*, v.orc ^.rcurou. 
Five schools vc::c contacted in order to obt-aI:i t:\o. c:^opur:i li on o£ Tour. A rriv'!.-- 
sample of ^?^pproxi:nat:cl y GO student:^ \:at: obLairi-cl froin u:icii scho..4. 'ilH" i^i, r r^..;,.-.1- 
v.'as adTiiinI r tered to tlie students durin^; scIjdoX Lovirs, uhns nsstn'iug p:;rL ici]Xit i v 
of those selected. 

Methods , 

Scores for each subject v.v.re coinputcd by tvo different raetnods: factor secures 
computed froir} a cornponent analysis and summative scores of tlic liiree itcirr, lorKiinj.', 
the highest on eacli factor. In tlie latter case, ite.riis v;erc as-a^'.ned to only one 
scale bailed on an a _priori decision to include only items with positive loauin[;s 
and to assign iteras not of unit complexity such that v;hen all scales vjere considered, 
the highest possible coribinationn of the loadings v^crc acquired. While r-iany of 
the items in tlie first tliroe scales v;ere not of unit coinplexity^ it wat' necefisn^-y 
to apply this rule for only one item. All ot]>.cr items not of unit coinplexity loaded 
amc'Hg the highest three on only one factor. Tlie factor scores v?crG obtained by 
first computing a principal components factor analysis follov;cd by a vai.bnax 
rotation of factors with eigenvalues greater than one. Factor scores v;ere then 
coiTiputed for each subject by itiul tiplyin?^ his standard score matrix by tbj inverr.e 
of the correlation riatrix by the varimax matrix. This may be represented by tlie 
formula: 

F= ZR" V (Horn, 19G5) . 
This method of computing factor scores, coramonly referred to as '^Little Jiffy" 
(Kaiser, 1970) was selected for this study because of its popularity in educational 
research (Cronbach, 1970; Kaiser, 1970, Glass and Taylor, 1966). In addition, 
there was no reason to assume tliat any of the variables being analyzed u^ere 
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opf^rating ^is^ randoM variables. The que^;rir>n of i:ho prc^-or ni:-:b - - ol f:^.,t.;ir.- l^* 
extract, a nuosLion v'hieii hns no't bi-^on a-^sv;i::i-cc . ; cat«_ ( i'c- lsuoK n , Iv/V) \\M 
be ciPproaclied in [his pnp::r. Ana]ysei> o£ thi.i ^cor::S I'u'.^ ob;:;-:i^:. c! ii>.' 1'.:^..-^: li:,' 
ooTTiput^^ tion of the correlation coe. .rficic:T:t :? i:fj Lacl:ori:il aual\\,ir, of i.;!:."^ 
utilizing eoch of the scores as a dcpeudcnL v^irlablo. Ihc indop^;ndc:H l vrii" 1 ■■.M ■ 
\\*ere race, social petition, and sex ecicl) linvi^:;^!, iwo levels:. Social posilioi/ v.u^:- 
obtained by employing llollinr-shead \s (195o) Pcalc. Subjects -.vliose f ^ri.ii 1 ics rot-.-] 
6 or bigher on the scale v;ere ii\ the low :^oc ial poKitioir r,roi'.p. 

Re5 ;ults an d D ? sxu.s^s^ on . 

The results v^ill bo pre.sented in throe sectionr. : 1) factor ana] vi^ 1?^ , 2) corrv?l:i- 
tions of factor scores and scale scores, 3) an ^inalysis of variance of ^CGicr> obLiiin./r) 
by each method. 

Factor Anal ysis . 

The priiicipal coniponentr; factor analy.'^is of the. data from the .saTr,plo oi 
ninth grade students produced twelve factors vJitli eigenvalues [:,rcater L}h'.;n one. 
Factor loadings rorulting froiTi the varimax rotation are presented in Tabic i . The 
highest three loadings on each scale and thi:s the itoms used in the calculation of: 
the suiniiiativG scale scores are underlined. A comparison of the items ornploycd to 
obtain the scale scores In this study and those recoTiimendcd by the instrunicnt 
developed are provided in Table 2. It appe<^rs that fovjer than the fifteen factors 
described by Super are required to define the. v^orlc value dimensions Included in tloe 
WVI. Gable, and Pruzek (1971) fomid ten factors produced by an image analysis to 
be meaningful. Items from some of the V7VI scales could be appropriately grouped 
on other scales. -Scales which vjere merged v/ere: 1) Economic Return-Surroundinf.'is - 
Associates, 2) Esthetics-Creativity, and 3) Prestige-Managenient . Results of the 
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TABLE 1. 

PrinciDal Conponents Rotated (Varimax) Factor Loadings for 
work Value Items* 



WVI ' Factors 



Items 


I 


li 


"III 


' IV 


V 


VI 


VII 


VIII 


IX 


X 


XI 


XII 


1 


-09 


11 


42 


17 


24 


-29 


23 


-16 


18 


24 


-18 


-22 


2 


-05 


-01 


80 


-01 


04 


-02 


04 


-03 


05 


03 


03 


02 


3 


09 


61 


^TS 


20 


-08 


03 


-09 


30 


-00 


10 


23 


-09 


4 


-03 


T? 


04 


14 


-02 


02 


07 


09 


-05 


70 


16 


01 


5 


-07 


12 


05 


16 


15 


66 


05 


08 


07 


1^ 


13 


09 


6 


11 


49 


03 


29 


03 


IT 


-07 


18 


13 


03 


-18 


-05 


7 


02 


22 


^05 


^ 


03 


15 


-14 


-06 


25 


06 


-09 


08 


8 


19 


23 


09 


-06 


"16 


19 


-39 


06 


22 


3; 


-14 


19 


9 


23 


65 


06 


06 


16 


06 


01 


10 


-02 


-01 


06 


12 


10 


-02 


02 


39 


12 


27 


19 


09 


-02 


49 


10 


12 


t03 


11 


01 


es 


03 


05 


10 


23 


-12 


02 


TT 


13 


66 


«0 8 


12 


13 


40 


13 


13 


45 


36 


-03 


-10 


08 


-00 


T3 


-U 


13 


23 


07 


04 


13 




08 


07 


05 


-08 


-04 


10 


-06 


14 


18 


22 


-08 


06 


01 


01 


-12 


70 


10 


* 13 


04 


-20 


15 


03 


03 


22 


59 


18 


-10 


26 


07 


11 


23 


07 


-05 


16 


02 


01 


05 


77 


19 


15 


07 


15 


-12 


06 


-02 


15 


17 


07 


08 


19 


T8 


70 


02 


08 


-05 


17 


09 


15 


25 


18 


16 


21 


09 


-13 


32 


03 


-01 


06 


-07 


02 


61 


-12 


19 


22 


74 


07 


-04 


11 


-02 


-04 


-04 


05 


-08 


TJ 


02 


20 


02 


07 


20 


33 


09 


19 


-11 


-07 


15 


02 


-09 


65 


21 


-14 


25 


17 


13 


30 


35 


19 


10 


34 


04 


-13 


21 


22 


26 


59 


-12 


*C3 


06 


24 


20 


17 


-04 


21 


10 


15 


23 


06 


-04 


07 


00 


i: 


13 


58 


20 


04 


35 


-16 


12 


24 


05 


11 


\2 


05 


-00 


07 


32 


71 


13 


02 


00 


17 


25 


32 


42 


-02 


-12 


18 


-16 


12 


Te 


-11 


17 


08 


41 


26 


25 


01 


04 


-09 


15 


42 


07 


-13 


19 


34 


14 




27 


44 


16 


34 


-05 


05 


08" 


21 


10 


-04 


18 


11 


02 


28 


65 


27 


10 


05 


29 


-08 


-08 


10 


06 


00 


-09 


-11 


29 


^ 


-14 


00 


10 


12 


08 


06 


-00 


15 


57 


-11 


-08 


30 


42 


-13 


63 


09 


1 3 


12 


08 


00 


-12 


ST 


00 


18 


31 


41 


-02 


62 


20 


09 


19 


12 


10 


-10 


-05 


05 


17 


32 


46 




V) 


19 


-08 


05 


04 


05 


00 


41 


06 


32 


33 


63 


22 


-01 


^OG 


05 


01 


-20 


32 


09 


nr 


-18 


01 


34 


65 


31 


19 


10 


-07 


14 


00 


06 


-13 


09 


03 


-05 


35 


36 


19 


10 


12 


-15 


53 


29 


-02 


09 


02 


06 


-09 


36 


57 


27 


-05 


-02 


12 


-156 


21 


09 


02 


06 


18 


15 


37 


45 


16 


12 


09 


-01 


-34 


02 


39 


24 


-07 


07 


10 


38 


24 


13 


27 


14 


02 


14 


60 


02 


13 


00 


-02 


-09 


39 


47 


51 


-14 


-02 


-14 


13 


IT 


-02 


09 


15 


17 


00 


40 


U 


-00 


-12 


07 


-04 


09 


04 


31 


74 


00 


00 


06 


41 


30 


25 


-05 


40 


-23 


-15 


05 


-02 


3? 


01 


14 


36 


42 


42 


48 


-10 


10 


-23 


-07 


08 


-00 


13 


-09 


35 




43 


62 


09 


01 


-03 


06 


07 


14 


-04 


03 


08 


44 


11 


44 


55 


-07 


06 


12 


30 


10 


15 


-07 


'36 


03 


05 


07 


45 


40 


-09 


24 




10 


06 


37 


-04 


T7 


02. 


00 


-00 



* decimals have been omitted. 
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v;crc also r^roupi'd. 

The prob tiiC'L c^rjjc frori c c: .puting ;x;a]^: ticjt.ytjj^ T'^'m* '•'■■•'^ • 

itenjs of a f^cLor cnaly:;i3 can be ob.-::ivcc i.W iVoir ^ ilv: 'j r-r- -{ [ ^ 1"'!.:^- 
scoresj often assuiiK-d to bo ^jp]^rr;pv o i [c^; of t]tc ":;cLcr s^o-..'5^ , ar^ 
higlily intGrcor. elntod. 'Hie intercoirrcl^i tioi^s . fci" i.h.: rivM^^a i i vl^ scor..:^' s::o.;ri in 
Tabln 3 coinputc-d uslvu^ 'c\ui three Itcius t:hat: ioeded Ihc ii;>:]i,::r o-i Mu' vcvioivd 
factors, ran^tid i;p 'to .47. 

A second problem \.'ith r;u::r;iativc scale ^.corcs is t:]ie:!r !i:-d.^st c^>rrul::r i v::> vl.iii 
t]\G actual varinoM f^jcror score froiii v:j^;.cii rhu r^calt^s wure d^-vived. A:.. 
Table 4 on the diagonal of the --natriM, the ct^rrel aLi cf t): i.c-L-;:;.! var^--^:: 
score and the corre.'^powli 3ca]e aeoro ranged frcm .66 Lo .84. 'ihu.. , ilic co::::v:aii 
variance benceen the l;\;o techniques raii^^ed fro;n ^3.G;( to 70. b;: vilP an avrragu oj 
54.76%, 

A Re search E::anale^ 

Researchers may be able, to accept rcale scores V7hi.ch correlate v/xth tlie factor 
scores as high as those found in this study on the basis of tlie results of. the 
correlational analysis. The true test, nov;ever , is to employ both typej:; oi scores 
in a typical educational research analysis and to ascertain v/ha.t types of conclusion 
vould be n^ac:e from ea(;h. Ihus an analysis of tlie tv7o sets of scores v;as made, 
utilizing the same data that was factor analyzed to explore the effects oC sex, 
race, and social position on v/ork values. Thifi 2x2x2 factorial analysis of variance 
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Tjble 5, tiiC: uiu of iJiC .:CtiV(: I'corc:- pr i. ^';:c^'.' ^^r^fi^^icr :^v:-Vv vf r J '. i' 
5^on^e effects cc:.::rr bou^ pr : - , br i i^: .• . , .. . 

The rcscr^rc'lier J terj^T'c. t Ln[; l^r: «i^Cllv^^i.si of vh j- <.i:;:~'::ci\':' i^:^:]:^ >.c<.»!n/ v.'.*-.:'^.^ 
corsclviclci thoi fc.:.:C.l(^i: nre: rnorc t rv? i tic c.-ffl; e:^ Llu^ric t]^r,^^ r:al..:-; \:hit.' 
more voIuG on vork \:h-t proviso variety InleUc-c Lii-] stir, mIu I: i o:. , a::.! 

oppor tuniticL: to provide sorvicc; to iDeir rdlio^^Kin (al lT u:i bl^:r:;r:: 
and that students i:Xiy/.\ hi^'Ii.^r t;acia] posltio}i p;iiiilic:3 crci i-orc ::Uj-vij;tic 
are students £rc:u lo\v r^ocial. position famil icf] . 

If the s3nK: rcsiiarclicr he-] cl):^3v.n to vr.-ploy frictor scores, ho \'ou]cl hi-vc 
concluclod tliat female:?; ar^:: nK;i'e ::Ii:ruistic t ^ -in i 1 or^ ; vh5,Lc:^ vcloc v^Mioty in 
their work and seel;, presti^'e :T;:-rc thJU do l:>lnchi|; awd tl^ot student:- iro:) li* h 
social positiort families plr.ce n^ore value ou inaependcnco - v.'ev o' life emu les:. 
valno on supervisory relations than do stuuei^. t;^: j;ro.:i Ion iKK.-i.al. p.vr'rion IiiJlw --. 
Thus the tvo ricthods oi sco]-ing produced consistcr.t t^i^^ni f i.ean L r\'J.n eireetr in 
the^^e analyses for race on the varicity scale and sex on the altruj.^j-.n scale- All 
other sionificant main effects uere unique to the! parti.cul^ir rjcoring procc^dnre. 

Cone lusions . 

Some proponents of factor av^alysis, sue!:; as Gucrtin an:! Dai] cy (1970) contend 
that the paradigm for dctemiining validity by correlating fectorr; on an instruii.ant 
with some CKternal criterion is antiquated. The paradigm proposed is to cnploy 
factor analysis to "conceptually validate'^ ncv; instruments. Many resecrchcrs have 
employed this paradigm to 'Validate/' research Instrnnicnts , but have not follov:cd 
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( ^ . n c ' :-. {: ]. o ^-j j. c a i s i. c \y to p r o d u c c f actor 5.; C" c < r c : s \ ; ] li c h \-; o u Icl \' i. e 1 ( 1 

1 id 1 vidua 1 s ul.j ■] cc: L s oa tl le \ « u d ur ly in g c on s l. r uc t: s vl i i cl i 1 i . : v c b o I'li 
"validated." RaLhv.r tiiciy proC!::ide to sum lIjo rav/ i^jcorcs of Ihci ]]i\i,\\i\y,t loading 
items which is often thro\viug together junk with the srore beiiig sought'. in the 
research eK^nnple^ it v/as ,shov/n that the tv/o niothochs of scoring produce sub.s la.niinlly 
different result^'. An investigation of the inLercorrelatious of smr.iativc scali- 
scores as V7cll as the cross-correlations of tiie su'^imative scale scores v;ith the 
actual varimax faetor pcores reveal that the Assouiate-rrcsLi^.;,e value > the moni 
salient factor, has a considerable aniount of common variance v/ith at lea.st i:i>: 
other scales. This common variance could easily account for significant main 
effects in the analysis of variance that emerged for the suruiiative scale scores 
and not for the factor scores. 

Since variir.ax factor scores, as "all other factor scores in component analysis > 
are uncorrelated ^ it seems reasonable to assume that the degree to which the 
correlation of summative scores and factor scores computed on the same data 
deviate from unity, is an estimation of their deviation from "conceptual validity." 
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